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Abstract 

We propose using a Bayes procedure with uniform improper prior to deter- 
mine credible belts for the mean of a Poisson distribution in the presence of 
background and for the continuous problem of measuring a non-negative quan- 
tity 9 with a normally distributed measurement error. Within the Bayesian 
framework, these belts are optimal. The credible limits are then examined 
from a frequentist point of view and found to have good frequentist and con- 
ditional frequentist properties. 



1 



Typeset using REVT^ 



I. INTRODUCTION 



We consider two simple problems for setting confidence belts. The first problem is that 
of the Poisson distribution in the presence of background. The second problem is the mea- 
surement of a non-negative parameter 6', with a normally distributed error. Although simple 
problems, there has been considerable work and discussion on them in the last few years. 
Most of the discussion has centered on the Poisson case, when the number of observed events 
is small. This is an important current topic because there are many search experiments in- 
volving small numbers of events. These include Higgs particle searches, supersymmetry 
searches, and neutrino oscillation searches such as LSND and KARMEN. 

We will briefly describe some recent attempts to address these problems. 

II. THE FELDMAN-COUSINS UNIFIED APPROACH 

The standard method for setting 90% CL bounds has been to select a region with a 
5% probability above and a 5% probability below the bounds. About two years ago, Gary 
Feldman and Bob Cousins |I[ suggested a method, new to physics analyses, called the unified 
procedure. For the Poisson case, for each possible value of the parameter 9, they looked at 
the ratio of the probability of getting the observed number of events n for that 9 compared 
to the maximum probability for all physically allowed ^'s, and picked ra's with the highest 
ratio to build a 90% confidence region. This solved two problems with the old procedure. It 
automatically transitioned from an upper limit to a confidence belt and it always produced 
confidence sets in the physical region. 

The unified procedure works well for many problems and is a significant improvement 
over the symmetric tails procedure. However it has a serious problem if few or no events are 
observed. If events are seen, there are signal and background events. That there are 
background events is interesting, but irrelevant to the question of whether signal events are 
seen. A 90% CL. limit on 9 should come from pe(0) < 10%, which sets a limit a,i 9 = 2.3. 
(Throughout this article probabilities for a fixed parameter A are denoted by a subscript 
Px- Probability densities and probability masses are denoted with lower case letters and 
distribution functions by upper case letters.) Such a case did occur in the Summer of 1998 
from initial KARMEN results 0. They had events with a background of 2.88, and using 
the unified method obtained an upper limit of 6' = 1.08. It is desirable to have a method set 
a confidence limit near 2.3, independent of background, for a 90% C.L., when no events are 
seen. 

HI. THE ROE-WOODROOFE PROCEDURE 

We presented a variant of the Feldman-Cousins unified procedure which corrected 
this problem and introduced the concept of conditional coverage. For any observation we 
know that the background is less or equal to the observed number of events, Uobserved- We 
suggested the use of a sample space not of all experimental outcomes, but of outcomes with 
background < Uobserved- Thus, if Uobserved = 4, we considered only measurements in which 
there are < 4 background events, even for 20 events observed in the sample space. This 
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probability was used both to set the ratio used in the unified method and to calculate the 
coverage probability. This method had the advantage of giving an upper limit of about 2.42 
for observed events independently of the background mean b. See Figure 1. 

Robert Cousins found that this procedure had a problem with its lower limit when 
applied to a continuous observable. Suppose one measures a parameter 6 > with a 
measurement error A, x = 6 -\- A, where A is normal (0,1). The R-W procedure eliminated 
6 = for all x > 0. However, if 6* = 0, the probability of measuring x > 1.39 is 10%. See 
Figure 2. It appeared that the R-W upper limit and the F-C lower limit were needed. 

Since the conditional coverage concept is, as yet, unfamiliar, it is desirable that a method 
should have reasonable conventional coverage as well as conditional coverage. 



In this section, we derive Baysian credible intervals when the expected signal is given 
a uniform prior distribution. These intervals have several desirable properties. Like the 
unified intervals, Bayesian intervals lie in the physical region and automatically change 
from confidence bounds to two-sided intervals. They avoid the known pitfalls mentioned 
above, the problems with low counts in unified method and the large lower boundary of 
the conditional confidence intervals in the continuous case. Finally, and importantly, the 
Bayesian intervals are optimal on their own terms. The intervals derived minimize length 
among all credible intervals. The price paid for these desirable properties is dependence on 
the prior and metric. We address the first of these concerns by showing that the frequentist 
coverage probability of the Bayesian intervals is quite close to the Bayesian posterior credible 
level. That is, while the two probabilities are conceptually quite different, they are close 
numerically. In addition, we show that the Bayesian credible intervals have exact conditional 
(frequentist) coverage probability, except for discreteness in the Poisson case. With regard 
to the metric, it is primarily the optimality of our procedures that depends on the metric. 
See Section 7. 

We will illustrate with two examples, a Poisson case in which the mean is composed of 
an unknown signal mean ^ > and a known background mean b and the measurement x of 
a parameter ^ > 0, with a measurement error A which is normal (0,1). We use a uniform 
(improper) prior of 1 for < 6' < oo in both problems. 



This is a simple problem in which the statistical issues are clear and which approximates 
the Poisson problem for large 6-1-6'. We measure x = ^ -|- A, where ^ > 0, and the density 
function for x is 



IV. BAYESIAN CREDIBLE INTERVALS 



A. The Continuous Example 




(1) 



For the uniform prior probability pr{6) = 1, the marginal density of x becomes 
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where 

Hx) = / (l){y)dy, 

the standard normal distribution function. We now use Bayes theorem f{x\6) x pr{6) = 
f{0\x) X f{x). The conditional density of 9 given x is 

/(6'|x) is proper; the improper (infinite) prior has cancelled out. We wish to find an upper 
limit u and a lower limit i, dependent on x, for which 

Prob{i <9 < u\x} = 1 - e. (3) 

In Bayes theory, such intervals are called credible intervals. It is desirable to minimize the 
interval [i,u], subject to (^. We do that by picking ^^'s with the largest probability density 
to be within the interval, 

[i,u] = {9:f{9\x)>c}, 

where < c < l/-\/27r is chosen to satisfy Equation (|). Now, f{9\x) > c if and only if 
1^ — x| < d, where 



d= ^-21nc-ln(27r) - 21n[<l>(x)]. 
There are two cases to be considered. If d < x, then the condition becomes 

<P{lu) , 2^d) - 1 



1 - e = r^'' f\9\x)d9 = r tcrldu 



d = ^-'[l + \{l-eMx)], (4) 



where $ denotes the inverse function to $. If x < d, becomes 



Ix+d Jd ^{x) ^{x) 

d = ^-^[1 - e^x)]. (5) 
If Xq is the point where these two curves meet, then, 

x„ ^ (^) . (6) 

Hence, the desired credible interval is [i, u] = [max{x — d, 0), x+d], where d = ^^^[l — e^{x)], 
if — oo < X < Xq, and d = $^^[| + |(1 — e)$(x)] if xq < a; < oo. 
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B. Poisson Example 



The probability mass function and distribution function for the Poisson distribution with 
mean A are: 

Pxin) = — . (7) 

nl 

and P\{n) = Pa(0) + ■ ■ ■ + P\{n). For our present problem \ = 6 + h, where 6 > is the 
fixed (known) "background" mean. If we let 9 have a prior uniform distribution pr{9) = 1 
for ^ > 0, we then have 



fCO 1 

p(n)= —{d + hYe-^^+^^pr{e)de 
Jo n\ 

oo 1 

— cj"e-'^rfcj = Pb(n) (8) 
b n'. 

as derived in our previous paper 0. The derivation proceeded by expanding {9 + 6)" and 
noting that 6^e~^d6 = k\. We again use Bayes' Theorem p0^h{n) x pr{6) = pb{n,6) = 
Ph{6\n) X p[n). Then, recalling that pr{6) = 1 for ^ > and p{n) = Pb{n), we have 

To set upper and lower confidence bounds for 9, we need to solve the equation 

1 r fo\ \M Pb+eM - Pb+unin) , . 

1 - e = / Pb{O n)de = — (10) 

for i and u. A 90% C.L. corresponds to setting e = 0.1. The second equality here is obtained 
by writing = — and using the reasoning described after Equation (8). To get the 
shortest interval u — i we need to include values of 9 with highest density, i.e., 

[i,u] = [e:pt{9\n)>c] (11) 

for some c. The conditions (10) and (11) may be solved numerically by an iterative procedure. 
This procedure is described in Section 6 in a more general context. 



V. FREQUENTIST PROPERTIES 

The Bayesian credible intervals just derived have exact posterior coverage probability 
1 — e, by construction. In this section, we show that they also have high frequentist coverage 
probability. 
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A. The Continuous Example 



In the continuous example, x = 6 + A,9 > 0, and A ~ normal(0, 1). Fix a 6 and find the 
points at this fixed 9 where x meets the upper and lower Bayesian limits. Let Xi{9) be that 
X which meets the upper limit, 9 — u{x£) — X£ + d{x() and Xu{9) be that x which meets the 
lower limit, 9 = i{xu) = Xu — min[d{xy),x^i]. Then [i{x),u{x)] covers ^ iff a;^ < x < x^, and 
the conventional unconditional coverage is — 9) — — 9). This is not exactly 1 — e. 
A lower limit on the coverage is shown in the Appendix to be 

-9)- ^xe -9)> (12) 

but this is a very conservative limit. For e = 0.1, this lower limit is 0.8182, while a numerical 
calculation finds a minimum coverage of about 0.86. 

The conventional coverage probability can be improved for a very small increase in limits. 
We will consider a conservative ad-hoc modification of the upper limit on 9 using the one- 
sided limit for a higher confidence level, e' — e/2. Let 



u'{x) — max u{x),x + ^ ^ ~ 2^) 



Let x'f be the X corresponding to u'{x) = 9. The formula for the conventional coverage is 
— 9) — ^{x'^ — 9), as above. The under cover age, derived in the Appendix, is very small 
for this conservative modification. For a 90% C.L., the conventional coverage is at least .900 
everywhere to three significant figures. Figure 3 shows a plot of the coverage bands, plotted 
as 9 — x vs X. The confidence bands are shown in Figure 4 and compared with the old R-W 
upper bound and the Fcldman- Cousins unified procedure lower bound. The conventional 
frequentist coverage for the Bayesian model and for this conservative modification are shown 
in Figure 5. 

The Bayesian credible intervals also have an exact conditional frequentist property, in 
terms of the error A = x — 9. Note that if x is observed, then, necessarily, A < x, since 
9 > 0. ^{x) is just the probability that A < x. Let a{x) = min[d{x),x]. Then the 
interval [£{x),u{x)] covers 9 iff £{x) < 9 < u{x) or, equivalently, —d{x) < A < a{x). In the 
Appendix, it is shown that if x' = ^ -|- A' is an independent copy of x, then 

Prob0[-d{x) <A'< a{x)\A' < x] ^ 1 - e 

and [£{x),u{x)] is the shortest interval with these properties. 



B. The Poisson Example 

As in the continuous case, the conventional coverage is not exact in the Poisson case. 
For 6 = 3 and 1 — e = 0.9, for example, the conventional coverage varies from about 86% to 
96.6%. Figure 6 shows the resulting confidence belt for 6 = 3, e = 0.1. 

The conditional coverage is shown in the Appendix to be f^i 1 — e, except for discreteness. 

The conventional coverage can be improved by a small ad hoc modification similar to 
that used for the continuous case. Consider an alternate Bayesian upper limit u' for 9 defined 
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as the one-sided limit for a credible level — 1 — e'. Take the modified upper limit as the 
maximum of u and u'. In the continuous example we chose e' = e/2. Here, we make a 
different ad hoc choice. The effect of the modification for 6 = 3, e = 0.1 and e' = 0.08 is 
shown in Figure 7. The value of the limit for n = then increases from 2.3 to 2.53. See 
Figure 8. For a fixed e' the limit at n = is independent of 6, but the appropriate choice of 
e' will depend weakly on b. 



VI. PARTIAL BACKGROUND-SIGNAL SEPARATION 

In this section, we extend the method to processes in which we have some information 
concerning whether a given event is a signal or a background event. Suppose on each event 
one measures a statistic x (or a vector of statistics) for which the density function is g{x) for 
signal events and h{x) for background events. Suppose, further, that the number of observed 
events n has a Poisson distribution with mean b+6, where 6 is the expected number of signal 
events. We assume that b, the expected number of background events, is known. Then the 
joint probability mass function/density for observing n events and parameters Xi, ■ ■ • , is 



^' k=i 



9g{xk) + bh{xk) 

b + e 



1 " 

J_p-{b+e) 



(13) 



k=l 



fc=l 



where r{xk) = g{xk)/h{xk)- For a uniform prior, pr{9) = 1 for < 6' < cxo, the marginal 
and posterior probability mass function/densities of n and Xi, • • • , x„, and of 9 are then 

roo 

f{n,x) = / fe{n,x)d9 
Jo 

= A TT hUk) X / e-(''+^) n + 9r(xk)]e-^''+''^d9 
^' k=i k=l 



Observe that 



where 



and where ji 



q{9\n, x) 



fe{n,x) 
f(n,x) ' 



/ e-(^+^) n + 0r{xk)]d9 = n\ J2 C, 

■'^ k=l m=0 



' {n — m)\ ' 



n,m 



1/ 



n 



m 



jiH Vjn=m k=l 



(14) 



(15) 



■ jn are restricted to the values or 1. Cancelling common factors, 

e-'m=i[b + 9rixk)] 



q(9\n,x) = 



(16) 
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Observe also that if g = h, then Cn,m = 1 and q{6\n,x) is the same as the posterior density 
of 6 given n in the Poisson case without the extra variables x. 

We want to find upper and lower limits u, i for 6 such that Prob{i < 6 < u\n, x} = 1 — e 
and to minimize that interval. This means we want [£, u] = {6 : q{6\n, x) > c}. We first find 
the value 9max at which q{9\n,x) is maximum, or, equivalently, ln[g(6'|n, x)] is maximum. 
Since the denominator in Equation (|16D 



D = n\J2 7 T^Cn,m (17) 



does not depend on 6, 



|>.>i.(«i«,.)i^|:^-i. 



If r(xi) ■ ■ ■r(x„) < b, then 9max = 0. Otherwise, setting the derivative equal to then leads 
to the equation 

ft — \ ^ ^max^{Xk) , s 

If g = h, then it is easy to see that 9max = max[0, n — b]. It is clear from (0) that 9max < 
and it can be shown that the obvious iteration starting aX 9 = n converges to 9 max- This 
iteration is a special case of the EM algorithm [^. 
Next integrate q{9\n,x). Let 



Q(a|n, x)= / q{9\n,x)d9. 

Then 



1 " 
Q{a\n,x) = - e-'ll[b + 9r{xi)]d9 



^E&"-'"a,™f'' ) / 9"^e-'d9. (19) 



m=0 

We use the reasoning described after Equation(8) to evaluate this integral. 

—a Y^n ft" ^Cn,i v^i 
_ Z^i=0 (n-i)! ^/=0 i! 

En fjn — m ^ 

m=0 (n-m)!*^".'^ 



(20) 



We can use either Equation (19), recognizing that the integral is an incomplete gamma 
function, or use Equation (20) to find Q{a\n^x\ The limits can then be found by iterations 
as follows. 

1. First solve the equation Q(z|n, a;) = 1 — e for z. This is straightforward, since Q(^z\n^ x) 
is increasing in z. 
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2. If q{z\n,x) < q{0\n,x), then £ = and u = z. 

3. If q{0\n,x) < q{z\n,x), solve the equations 

q{y\n,x) = c, 

q{z\n, x) = c, 

Q{z\n, x) - Q{y\n, x) = 1 - e 

for c,y,z by a double iteration. In solving these equations, start with c = {cmin + Cmax)/'2, 
where Cmm = q{0\n,x) and Cmax is the maximum value of q{9\n,x), corresponding to 6^ = 
(^max- Solve the first two equations for y < O^ax < z. This is straightforward, since q{0\n,x) 
is increasing for 6 < Omax and decreasing for > Omax- Then replace Cmax (respectively, 
Cmm) by c, accordingly as Q{z\n,x) — Q(?/|n, x) < 1 — e (respectively, > 1 — e). 

Note that the iteration procedure for the Poisson example without additional parameters 
measured is just a special case of this iteration procedure. 

VII. CONCLUDING REMARKS 

We have proposed methods for setting credible/confidence intervals for the means 9 of 
a Poisson variable, observed in the presence of background, and of a normal distribution, 
when 6 is known to be non-negative. In the process, we have made specific choices for the 
prior distributions and loss structure. The (uniform) prior distributions were chosen for 
mathematical tractability and agreement between the Bayesian credible level and conven- 
tional confidence level; and one of the main findings is that such agreement is possible. The 
intervals have an optimality property: they minimize the length of credible intervals in the 
9 scale for the uniform prior. For both problems, the mean provides a physically meaningful 
and mathematically tractable metric. Our procedures depend on the choice of metric, prior, 
and loss structure as follows: if the interval for 9 is i < 9 <u and the metric were changed, 
to r = 1/9 say, then a valid interval for r is 1/u < t < 1/ 1. This has the same frequentist 
coverage as the original interval and is an exact credible interval for the induced prior, dr/r^. 
The optimality is lost, however. The transformed interval does not minimize length in the 
r-scale. The situation for our method is similar to that in the Cramer- Rao limit. Equation 
13.10 of Roe 0. This very useful bound also depends on the metric. 

The derivations of the ad hoc modifications in Section 5 mix Bayesian and frequentist 
reasoning, and this may seem inelegant. We believe that any inelegance is mitigated by the 
minor nature of the changes and the resulting good properties of the procedure from both 
the Bayesian and frequentist viewpoints. 

In the case of a Poisson distribution without auxiliary variables, there is a close connec- 
tion between our method and CL^: the CLg procedure is mathematically equivalent to an 
upper credible bound with a uniform prior distribution. Read calls this a coincidence. 
We think that there is a deeper connection The optimality claimed for CL^+g in Read's 
work is optimality for testing background only versus background plus a specified signal. 
Our procedures are designed to produce intervals of shortest length, not most powerful tests. 
That these two criteria can lead to different procedures was noted in the statistical literature 
by Pratt §. 
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APPENDIX: PROOFS OF COVERAGE AND OPTIMALITY THEOREMS 

1. Continuous Example 

Recall that if ,t = ^ + A is observed, then necessarily A < a; and that 9 G [^{x),u{x)] 
iff —d{x) < A < a{x), where d{x) = u{x) — x and a[x) — x — i{x) — 'min[d{x),x]. Let 
x' — 6 + A' he an independent copy of x. 

Theorem: For every x, Prob0[—d{x) < A' < a{x)\A' < x] — 1 — e, and [i{x), u{x)] is the 
shortest interval with this property. The first statement says that the conditional coverage 
of a; — is exact. 

Proof: The result follows from 

„ , r A / , W n ^\min(x, „ , r „ ,1 / . X 

ProbelA' < z A' < x] = ^ ^/ ' = Problx -B< z\x\. Al 

In words, the conditional frequentist distribution oi x' — 9 is the same as the posterior 
distribution ol x — 9. It follows that 

Proh0[—d{x) < A' < a{x)\A' < x] = Prob[x — u{x) < x — 9 < min{x,d{x))\x] 

= Prob[i{x) <9 < u{x)\x] = 1 - e, 

where the last equality follows from the definitions of £{x) and u{x). Next, if [L{x), U{x)] is 
any interval for which Probg[—D{x) < A' < A{x)\A' < x] = 1 — e, where D{x) = U{x) — x 
and A{x) = x — L{x) , then 

Prob[L{x) <9 < U{x)\x] = Prob[-D{x) <x-9 < A{x)\x] = 1 - e 

and, therefore, U{x) — L{x) > u{x) —i{x), since the Bayesian limits were chosen to minimize 
the length of the interval. 



To put this in more conventional terms, let the interval C{x,x') = [x' — a{x),x' + d{x)]. 
Then 

Prob0[C{x, x') 3 9\A' <x] = l-e, (A2) 

where x' is the random variable. 

Theorem: A lower limit for the conventional coverage is (1 — e)/(l +e). 

Proof: Recall that Xi and x^ were the values of x for a given 9 meeting the upper and 
lower Bayesian limits, so 6* = u{x£) = X£ + d{xe) and 9 = £{xu) = Xu — min[d{xu),Xu]- The 
unconditional frequentist coverage probability is 

Probe[i{x) <9< u{x)] = Probelxe < x < Xy] = ^{xu - 9) - ^{xe, - 9). 

Recall the definition of Xq and observe that > Xq for all ^ > 0, since 9 = i{xu) and 
£{x) = for x < Xq. First suppose that x^ < Xq. Then < ^{xq) < and 
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$(xo) = 1/(1 + e) by (6). Also, by (4) and (5), -6)^ ^-d{xe)] = 1 - ^d{xe)] = 
e^xe), -9)^ = | + |(1 - e)$(x„), and 

- ^) - - ^) = 1 + 1(1 - e)$(x„) - e$(a;,) 

1 11 -e € 
> - H 

- 2 21 + e 1 + e 

1 -e 
> . 

- 1 + e 

Next suppose xe > xq. Then $(a;„) > ^{xe) > ^{xq), ^{xe - 0) = ^[-d{xe)] = 1 - 
I + 1(1 - e) ^{xi)], and 



^xu -9)- ^xe -9) = - + -{l- e)$(a;J - 1 + 

= l(l-e)[$(x,) + $(x„)] 



l + l(l-6)$(a;,) 



> 



1-e 





Theorem: For the modified procedure a lower limit to the conventional coverage is given 
by ^ + 1(1- e)^{xu) - min (|, $(a;,)) e. 

Proof: For the modified procedure, the upper limit is defined as 



u'{x) — max 



u{x),x + $ 



-1 



We set x'f^ to be the x corresponding to u'{x) = 9. Then = min[xi, 9 — $~^(1 — |e)], and 
x'^ — 9 < — $~^(1 — e/2). Observe that u'{x) = u{x) for ,x < and u'{x) = $^-"^(1 — |e) for 
a; > 0. For if x < 0, then u{x) — x = d{x) = $"-'^[1 — e$(x)] > $^^(1 — ^e) using Equation 
(5). Similarly, ii < x < Xq, then u{x) - x = d{x) = $"^[1 - e$(a;)] < $~^(1 - ^e); and if 
xq < X < oo, then u{x) - x ^ d{x) = $"^[| - |(1 - e)$(x)] < $~^(1 - ^e). It follows that 
x'f = X£ for < and x'^ = 9 — $^^(1 — |e) if xg > 0. 

So, if xe > 0, then x'^ - 9 ^ -$"^(1 - ^e) = $~^(|e) and, therefore, 

$(a:^-^) = $[$-^(i6)] = l6. 



If Xi < 0(< xo), then 
Hence 



^x'i-9) = ^xe-9)^e^xe). 



^{x'g — 9) — min 



and the theorem follows from <^{xu - 9) - <^{x'i^ - 9) = \ + \{l - e)(^{xu) - $(x^ - 9) 



(A3) 
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2. Discrete(Poisson) Example 

The Bayesian credible intervals are (nearly) exact conditional confidence intervals (except 
for discreteness) if we convert to a scale that is natural for conditional confidence. 
To see this, let 

„a 



Ha{y) = / e-'rfx, 
JO F a + l 



Jo Tia + l)" 

where F is the Gamma function. Then, using reasoning similar to that following Equation 
(8), Hn{^) = 1 — Pfi{n). From Equation (9), the posterior distribution function of 9 is 



rdo 

Prob(9 < 9o\n) = Q(9o\n) = / pb(9\n)d9 

Jo 

^ Hn{b + 9)-H^{b) 
Pb{n) 

Fix b and let fre^„(m) be the conditional probability of at most m events from the 
conditional sample space, given at most n background events in the experiment, i.e., 
Ke,n{rn) = Probg{< m events obtained |nfeacfcgroW < ri). Then 

Pe+bim) 

Ka„(m) 



Pb{n) 
for m < n, and 

1 " p"^ 

for m > n. Letting M be the random count obtained in a particular experiment 

Probe[Ke,n{M) < y\nbackground <n]^y (A4) 



for < y < 1, where the approximation arises because m is discrete. Specifically, ( |A^ ) is 

exact for y of the form y = Kg^n{m), since Probe[Ke,n{M) < Kg^ri{rn)\nhackground < n] = 
Probg[M < m\nbackground < n] = Ke^ri{m) for all m = 0, 1, 2, ■ ■ -. 

Clearly, < ^ < u„ iff 6 + 4 < 6 + ^ < 6 + u„ iff Hnib + £„) < + 9)<Hn{b + u^). 
Thus, 4 < < Mn iff 1 — Hnip + u„) < PQ^b{n) < 1 — Hnib + or equivalently. 

Using ([A^), the conditional probability of the latter event given Ubackground < n is approxi- 
mately 

H^{b + Un) - Hn{b + in) , , , 

m = '-^' ^^'^ 

where the last equality follows from the definitions of and m„. 

To appreciate (|A5|) , it is instructive to use a different approach. Suppose that we knew 
apriori that Ubackground < Then the mass function of M is then 

Probe{M = m\nbackground <ri) = kg^n{m) = Ke,n{m) - Ke^nim - 1). 
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To form confidence intervals in this model, we might construct tests that the parameter has 
a given value and then invert this family of tests. This requires finding and n„ for which 
Proheijii < M < nu\ni,ackground < n) > 1 — e for each 9, where rii and n„ are functions of 9 
and n. This implies and is nearly equivalent to 

Probe[Ke-aine) < Ke^n{M) < Ke^n{nu)\nbackground <n]>l-e. (A6) 

Except for discreteness, the left side of ( |A6|) is Kg^ninu) — Kenijif). The Bayesian credible 
intervals implicitly determine values of ni and n^, namely 

, X l-Hn{h + Un) 



Ke,n{nu) 



Pb{n) 

The relation ( |X5| ) shows that these values nearly satisfy (X6), except for discreteness. 



13 



REFERENCES 



G. J. Feldman and R.D. Cousins, Unified approach to the classical statistical analysis of 
small signals, Phys. Rev. D57, 3873 (1998). 

K. Eitel and B. Zeitnitz, The search for neutrino oscillations z/^ z/g with KARMEN, 
in Neutrino Physics and Astrophysics, Procedings of the XVIII International Conference 
on Neutrino Physics and Astrophysics, Takayama, Japan, edited by Y. Suzuki and Y. 
Totsuka, North Holland (1999). 

B.P. Roe and M.B. Woodroofe, Improved Probability Method for Estimating Signal in 
the Presence of Background, Phys. Rev. D 60, 053009 (1999). 

Robert D. Cousins, Application of Conditioning to the Gaussian-with-Boundary Problem 
in the Unified Approach to Confidence Intervals, |arXiv:physics/0001031| , 15 Jan 2000, 
submitted to Phys. Rev., 2000. 

A. P. Dempster, N.M. Laird, and D.B. Rubin, Maximum Likelihood from Incomplete 
Data via the EM Algorithm, Roy. Stat. Soc. B39, 1 (1977). 

B. P. Roe, Probability and Statistics in Experimental Physics, Second Edition, Springer- 
Verlag, New York, to be published in 2001. 

A.L. Read, Modified Frequentist Analysis of Search Results (The CLs Method), Proceed- 
ings of the Workshop on Confidence Limits at CERN, January 17-18, 2000, to be issued 
as a CERN Yellow Report. 

H. Wang and M. Woodroofe, to appear in Ann. Statist. 
J. Pratt, J. Amer. Statist. Assn., 56 549-567,(1961). 



14 



FIGURES 



1 4 



1 2 



1 



o 

c 
o 

(1) 8 



□ 
C 

(7l 



Old R\ 
FC 



6 8 

leasured n 



10 



1 4 



Poisson Confidence Region (b = 3. 



FIG. 1. The 90% C.L. belt for a Poisson probability with 6 = 3, using the old R-W procedure 
(solid line) and the Feldman-Cousins unified procedure (dashed line). 
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FIG. 2. The 90% C.L. belt for the continuous probability example, using the old R-W procedure 
(solid line) and the Feldman-Cousins unified procedure (dashed line). 
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FIG. 3. The 90% C.L. belt plotted as 6 — x vs x using the Bayesian procedure and a conservative 
modification (dashed) for the continuous example. 
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FIG. 4. The 90% C.L. belt using the Bayesian procedure (solid line) and the conservative 
modification (dashed line) for the continuous example. The old R-W upper limit and the F-C 
unified method lower limit are shown as dotted lines. 
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FIG. 5. The conventional frequentist coverage for a Bayesian 90% C.L. belt for the Bayesian 
continuous model (solid line) and the conservative modification (dashed line). 
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FIG. 6. The 90% C.L. belt for the Poisson distribution with 6 = 3 using the Bayesian procedure 
and the old R-W procedure (dashed line). 
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FIG. 7. The conventional frequentist coverage obtained by this Bayesian procedure (sohd hne) 
and by the conservative modification (dashed hne) for 5 = 3. 
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FIG. 8. The 90% C.L. belt for the Poisson distribution with 6 = 3 using the Bayesian procedure 
(sohd hne) and the conservative modification (dashed hne). 
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